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ROBUST DIGITAL IMAGE WATERMARKING UTILIZING A WALSH TRANSFORM 

ALGORITHM 

Field 

[0001] Embodiments of the invention relate generally to digital image processing, and more 
particularly, to robust digital image watermarking techniques utilizing a Walsh transform 
algorithm. 

Description of Related Art 

[0002] Rapid and extensive growth in Internet technology has created a pressing need to 
develop techniques to protect copyright ownership and the content integrity of digital media 
content. This demand has arisen because digital representation of medias, with their inherent 
advantages of portability, efficiency, accuracy of information, and ease of copying, places 
digital media content under a serious threat because an unlimited number of perfect copies of 
an unprotected digital content can be illegally made with relative ease. One proposed 
solution to this problem is the use of a electronic stamp or digital watermarking, which is 
intended to complement a cryptographic process. See, for example, R. Anderson, 
Information Hiding, Proceedings of the First Workshop on Information Hiding, LNCS-1 174, 
Springer Verlag, New York, 1996 and N.F. Jhonson and S. Jajodia, Exploring 
Steganography: Seeing the Unseen, Computer, vol. 31, pp. 26-34, 1998. 
[0003] Basically, a digital watermark is a pattern of bits that is embedded into a file that is 
used to identify the source of the file. For example, if a digital watermark is placed into a 
master copy of an audio compact disk (CD), then all copies of that CD may be uniquely 
identified. Particularly, digital watermarks can also be effectively utilized in digital image 
files. Thus, if a digital watermark is placed into a master copy of a digital image file, then all 
copies of that digital image file may be uniquely identified. 

[0004] Generally, all watermarking methods share the same basic building blocks: an 
embedding system and a watermark recovery system. See, for example, S. Katzenbesser and 
F.A.P Petitcolas, Information Hiding Techniques for Steganography and Digital 
Watermarking, Artech House, Boston, MA, 2000. Most generic embedding systems have as 
inputs: a cover that is the data or image to be hidden (I), a watermark symbol (W) that can be 
an image, text, number, etc., and a key (K) to enforce security. Typically, most systems 
employ one key or a combination of several keys. Depending on the type of key used in the 
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watermarking process (e.g. a private or public key), the watermarking process is usually 
referred to as a private or public watermarking process, respectively. The output of the 
embedding process is always the watermarked data. 

[0005] Typically, a generic watermark recovery process requires the watermarked data, the 
private or public key, and depending on the method, the original data and/or the original 
watermark symbol as inputs while the output is the recovered watermark symbol with some 
kind of confidence measure for the given watermark symbol or an indication about the 
presence of watermark symbol in the cover data or image under inspection. 
[0006] Depending on the combination of inputs and outputs there are generally three types of 
standard watermarking processes: private, semi-private, and public. See, for example, 
Kutter, M., F.A. P. Petitcolas, Fair Benchmarking for Image Watermarking Systems, 
Proceedings of the SPIE 3657, Security and Watermarking of Multimedia Contents, 1999, pp. 
226-239. 

[0007] For example, private watermarking systems (also called non-blind watermarking 
systems) typically require at least the cover image and/or watermark symbol and the key (if 
used in embedding) for the recovery of the watermark symbol. Two types of private systems 
are typically used. The first type of system (Type I) uses the cover image (I) to locate the 
hidden information and also to extract the watermark symbol from the possibly distorted 
watermarked data denoted (I")- In addition to the cover image, the second type of system 
(Type II) also uses a copy of the embedded watermark symbol for extraction and yields a 
"yes" or "no" answer about the presence of the watermark in the possibly distorted 
watermarked data. Mathematically this may be expressed as: (I" x I x k x W->{0, 1 }). 
[0008] On the other hand, public watermarking systems (also called blind or oblivious 
watermarking systems) require neither the cover image nor the embedded watermark symbol, 
but only the secret key during the detection of the hidden information (i.e. the watermark 
symbol). Mathematically this may be expressed as: {I" x k-> W}. 
[0009] Semi-private watermarking systems (also called semi-blind watermarking), as a 
subclass of a blind system, are capable of detecting only the presence of the embedded 
watermark symbol with the help of secret key and the original watermark symbol but without 
the cover image. Mathematically this may be expressed as: ( I" x k x w -»{0, 1 }). 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0010] Figure 1 is a flow diagram illustrating a broad overview of a process to implement 
robust digital image watermarking utilizing a Walsh transform algorithm, according to one 
embodiment of the present invention. 

[0011] Figure 2 is a flow diagram illustrating a process to implement partitioning, according 
to one embodiment of the present invention. 

[0012] Figure 3 is a schematic diagram illustrating an example of a shift register circuit. 
[0013] Figure 4 is a flow diagram illustrating a detailed process to implement robust digital 
image watermarking utilizing a Walsh transform algorithm, according to one embodiment of 
the present invention. 

[0014] Figure 5 shows a block diagram illustrating the extraction of a watermark symbol 
from the watermarked cover image, according to one embodiment of the invention. 
[0015] Figures 6 A and 6B are images showing a fishing boat and a women (named Lena), 
respectively, which are used as test cover images. 

[0016] Figures 6C, 6D, 6E, 6F, and 6G show test cover images of a bear, New York, a opera, 
an F151 aircraft, and pills which are used in testing the robustness of the embodiments of the 
invention for robust digital image watermarking techniques utilizing a Walsh transform to 
different possible signal processing operations. 

[0017] Figures 7A and 7B are the watermarked images of Figures 6A and 6B, respectively, 
using a watermark symbol (a hidden symbol "M") embedded therein, using the embodiments 
of the invention for robust digital image watermarking techniques utilizing a Walsh 
transform. 

[0018] Figure 7C shows the watermark symbol "M". 

[0019] Figures 8A and 8B show blurred versions of a watermarked image of a fishing boat 
after first and second time mean filtering operations. 

[0020] Figures 8C and 8D each show an extracted watermark symbol, which were extracted 
using the embodiments of the invention for robust digital image watermarking techniques 
utilizing a Walsh transform from Figures 8A and 8B. 

[0021] Figures 9 A and 9B show blurred versions of a watermarked image (Lena) after first 
and second time mean filtering, respectively. 
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[0022] Figures 9C and 9D each show an extracted watermark symbol, which were extracted 
using the embodiments of the invention for robust digital image watermarking techniques 
utilizing a Walsh transform from Figures 9 A and 9B. 

[0023] Figure 10 shows a table of test result of the robustness to mean filtering for the five 
test images, when utilized with embodiments of the invention for robust digital image 
watermarking techniques utilizing a Walsh transform. 

[0024] Figures 1 1 A, 1 IB, and 1 1C show watermarked images of a fishing boat after 1st, 2 nd , 
and 5th time median filtering, respectively. 

[0025] Figures 1 ID, 1 IE, and 1 IF show extracted watermark symbols, which were extracted 
using the embodiments of the invention for robust digital image watermarking techniques 
utilizing a Walsh transform from Figures 1 1 A, 1 IB, and 1 1C, respectively. 
[0026] Figures 12 A, 12B, and 12C show watermarked Lena images after 1st, 2 nd , and 5th 
time median filtering, respectively. 

[0027] Figures 12D, 12E, and 12F show extracted watermark symbols, which were extracted 
using the embodiments of the invention for robust digital image watermarking techniques 
utilizing a Walsh transform from Figures 12A, 12B, and 12C, respectively. 
[0028] Figure 13 shows a table of test results of the robustness to median filtering for the five 
test images when utilized with embodiments of the invention for robust digital image 
watermarking techniques utilizing a Walsh transform. 

[0029] Figures 14A, 14B, 14C, and 14D show a watermarked image of a fishing boat with 
various image cropping operations, respectively. 

[0030] Figure 14E shows a watermarked image of a fishing boat with a border image 
cropping operation. 

[0031] Figures 14F, 14G, 14H, and 141 show extracted watermark symbols, which were 
extracted using the embodiments of the invention for robust digital image watermarking 
techniques utilizing a Walsh transform from Figures 14A, 14B, 14C, and 14D, respectively. 
[0032] Figure 14 J shows an extracted watermark symbol, which was extracted using the 
embodiments of the invention for robust digital image watermarking techniques utilizing a 
Walsh transform from Figure 14E. 

[0033] Figures 15 A, 15B, 15C, and 15D show a watermarked Lena image with various image 
cropping operations, respectively. 
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[0034] Figure 1 5E shows a watermarked Lena image with a border image cropping 
operation. 

[0035] Figures 15F, 15G, 15H, and 151 show extracted watermark symbols, which were 
extracted using the embodiments of the invention for robust digital image watermarking 
techniques utilizing a Walsh transform from Figures 15 A, 15B, 15C, and 15D, respectively. 
[0036] Figure 1 5 J shows an extracted watermark symbol, which was extracted using the 
embodiments of the invention for robust digital image watermarking techniques utilizing a 
Walsh transform from Figure 15E. 

[0037] Figure 16 shows a table of test results of the robustness to different types of image 
cropping operation for the five test images when utilized with embodiments of the invention 
for robust digital image watermarking techniques utilizing a Walsh transform. 
[0038] Figure 1 7 A shows a table of test results of the robustness to JPEG compression for the 
five test images when utilized with embodiments of the invention for robust digital image 
watermarking techniques utilizing a Walsh transform. 

[0039] Figures 17B and 17C are the extracted watermark symbol after decompression from 
the JPEG compressed images of Figure 7A with compression ratios of 31.80 and 44.56, 
respectively. 

[0040] Figures 1 8A and 1 8B show a watermarked Lena image undergoing least significant 
bit manipulation. 

[0041] Figures 18C and 18D show extracted watermark symbols, which were extracted using 
the embodiments of the invention for robust digital image watermarking techniques utilizing 
a Walsh transform from Figures 18A and 18B, respectively. 

[0042] Figure 19 shows a table of test results of the robustness to deliberate least significant 
bit manipulation for the five test images when utilized with embodiments of the invention for 
robust digital image watermarking techniques utilizing a Walsh transform. 
[0043] Figure 20 shows a watermarked image of a fishing boat that has undergone changing 
gray scale levels. 

[0044] Figure 21 shows an extracted watermark symbol, which was extracted using the 
embodiments of the invention for robust digital image watermarking techniques utilizing a 
Walsh transform from Figure 20. 

[0045] Figure 22A shows a watermarked Lena image that has undergone changing gray 
scale levels. 
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[0046] Figure 22B shows an extracted watermark symbol, which was extracted using the 
embodiments of the invention for robust digital image watermarking techniques utilizing a 
Walsh transform from Figure 22A. 

[0047] Figure 23 shows a table of test results of the robustness to different possible changes 
in gray scale level for the five test images when utilized with embodiments of the invention 
for robust digital image watermarking techniques utilizing a Walsh transform. 
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DETAILED DESCRIPTION 
[0048] In the following description, the various embodiments of the invention will be 
described in detail. However, such details are included to facilitate understanding of the 
invention and to describe exemplary embodiments for employing the invention. Such details 
should not be used to limit the invention to the particular embodiments described because 
other variations and embodiments are possible while staying within the scope of the 
invention. Furthermore, although numerous details are set forth in order to provide a 
thorough understanding of the embodiments of the invention, it will be apparent to one 
skilled in the art that these specific details are not required in order to practice the 
embodiments of the invention. In other instances details such as, well-known methods, types 
of data, protocols, procedures, components, electrical structures and circuits, are not 
described in detail, or are shown in block diagram form, in order not to obscure the invention. 
Furthermore, embodiments of the invention will be described in particular embodiments but 
may be implemented in hardware, software, firmware, middleware, or a combination thereof. 
[0049] Embodiments of the present invention relate to a computationally efficient private 
watermarking technique using a Walsh transform. This watermarking process is robust 
against several types of external attacks and provides reduced visual distortion. In one 
embodiment, a block-based Walsh transform algorithm may be used to hide a watermark 
symbol in a cover image. For example, the watermark symbol, in one embodiment, may be 
copyright mark or another type of logo. 

[0050] Turning to Figure 1, Figure 1 is a flow diagram illustrating a broad overview of a 
process 100 to implement robust digital image watermarking utilizing a Walsh transform 
algorithm, according to one embodiment of the present invention. To begin with, at block 
1 10, the process receives a cover image and a watermark symbol. The cover image is then 
partitioned (block 120). Next, a key is generated (block 130). Based on the previous 
partitioning and the previously generated key, a watermark is inserted into the cover image 
utilizing a Walsh transform (block 140). Lastly, at block 150, the watermark is extracted 
from the watermarked cover image also utilizing a Walsh transform. Each of these individual 
process blocks will be discussed in more detail below. 

[0051] The process at block 1 10 first receives the cover image and the watermark symbol. In 
one embodiment, the cover image (I) may be a gray-level image of size N x N where N= 2 p 
and the digital watermark symbol or logo (L) may be a two level image of size M x M. In 
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one embodiment, the digital watermark symbol is preferably 1/16 or 1/32 of the size of cover 
image. It should be noted that the smaller the size of a digital watermark symbol, a 
correspondingly smaller amount of pixel values are required to be embedded in the image and 
the robustness of the process is increased. For explanatory purposes, an example in which a 
binary image of size (16x16) will be utilized as a digital watermark symbol and a cover 
image of size (256 x 256), 8 bits/pixel gray image, will be utilized. 

[0052] Also a brief description of the Walsh Transform will now be given. Assuming that 
there are N=2 n number of points in a one dimensional discrete signal f (x) (where n is positive 
integer), the discrete Walsh transform (DWT) denoted by W (u) is defined as: 

^(«)=iE/wfl(-i) M " 4 

[0053] Where b k (z) is the k-th bit in binary representation of z. See, for example, Gonzalez 
and Woods, Digital Image Processing, Addison-Wesley, New York, 1992. Hence the 
forward kernel of the one-dimensional discrete Walsh transform may be expressed as: 

[0054] The Walsh transformation kernel is a symmetric matrix having orthogonal rows and 
columns. This property leads to an inverse kernel that is identical to forward kernel, except 
for the constant multiplicative factor of 1/N. 
[0055] Accordingly, the inverse Walsh transform kernel is 

and the inverse Walsh transform is 

/W = g^( M )fl(-l/'^- ( " ) . 

u=0 i=0 

[0056] An advantage of the Walsh transformation over other unitary transforms, such as the 
Fourier transform, which have a kernel of complex exponential terms, is that the Walsh 
transform kernel consists of only a signed integer value +1 and -1, which does not require 
floating point multiplication during implementation. 

[0057] As previously discussed, the process at block 120 partitions the cover image. With 
reference to Figure 2, Figure 2 is a flow diagram that illustrates a process 200 to implement 
partitioning, according to one embodiment of the present invention. As shown in Figure 2, 
the cover image may be partitioned into non-overlapping square blocks of equal size (block 
210). Continuing with the present example, in which the cover image is of size (256 x 256), 
the cover image may be partitioned into non-overlapping square blocks of size (8 x 8) pixels. 
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A block may be denoted by the location of its starting pixel (x, y). In this example, because 
the cover image is of size (256 x 256), a total number of 1024 of such blocks may be obtained 
for watermark symbol insertion. 

[0058] Next, all such blocks are arranged in ascending order based on their variance values 
(block 220). Blocks having small variance values are defined as homogenous blocks (block 
230). Of course, the smallness in variance value depends on the characteristics of image to 
be watermarked. In this example, the watermark symbol is (16 x 16) in size such that only 
256 homogenous blocks are needed in order to insert one watermark pixel in each such 
homogenous block. 

[0059] Further, mid-variance range blocks may also be defined (block 240). Continuing with 
the present example, another set of 256 blocks ranging from the (512 - 128)th position to the 
(512+128)th position (i.e. from the 384 th to 640 th position) in ascending order arrangement of 
variance are defined as mid- variance range blocks and may also hide one pixel of a 
watermark symbol in each such block. 

[0060] In this way, a watermark symbol may also be inserted into two different sets of non- 
overlapping blocks to ensure redundant insertion of watermark pixels in the cover image. In 
order to aid in accomplishing this, two sets of files (e.g., look-up tables), termed a 
homogenous block file and a mid-variance file listing the location of homogenous blocks and 
mid-variance blocks, respectively, are created (block 250). These files are used in the 
insertion and extraction of watermark pixels through proper Walsh coefficients, as will be 
discussed. 

[0061] Next, a key is generated (block 130 of Figure 1, as previously discussed). 
Particularly, a pseudo-random number of suitable length is generated for use as the private 
key. Continuing with the present example, the length of the pseudo-random number for the 
private key would be 256. In one example, the pseudo-random number may be generated 
using a Linear Feedback Shift Register. See, for example, B Sklar, Digital Communication, 
Prentice Hall Englewood cliffs, N.J, 1998. 

[0062] For example, the manner of generating the pseudo-random number may be best 
illustrated by the polynomial representation f (x)= x m + a m .ix m-1 + a m . 2 x m " 2 + aix+1 in which 
the coefficients (aj) of the various powers of x are either zero or one. Looking briefly at 
Figure 3, Figure 3 is a schematic diagram illustrating an example of a shift register circuit 
300. The shift register circuit 300 that describes this polynomial is shown in Figure 3 in 
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which the outputs of the various stages 305 are fed back to the input through weighting 
coefficients 307 ai through a m -i. 

[0063] For the present example, to generate a pseudo-random number of length 256 a 
polynomial f (x)=x 8 +x 6 + x 5 +x 4 +l may be considered with initial values of all eight shift 
register set to 1 . In fact any combination of 0s and Is, except all 0s, may be used as input for 
the shift registers. The output may be taken from all eight-shift registers at a time for each 
clock input and their decimal equivalent is the number that occurred at that clock input. This 
way a sequence of length 256 is generated. Continuing with the present example, a sequence 
(e.g. 45, 36, 10, 23 . . ..67) may be generated and this sequence may be used to permute the 
watermark to disperse the spatial relationship. 

[0064] With the example sequence previously generated (i.e. 45, 36, 10, 23 ....67), spatial 
dispersion is implemented by inserting the 45th bit of the 1-D bit stream of the watermark 
symbol first, then the 36th bit, then the 10th bit, then the 23rd bit, etc. In this example, this 
spatially dispersed one-dimensional string of Is and 0s when converted to two-dimensional 
data of size 16 x 16, is used to create a spatially dispersed watermark symbol, which is 
denoted as Li for descriptive purposes hereinafter. 

[0065] Next, the spatially dispersed watermark symbol Li is inserted in the cover image 
utilizing a Walsh transform (block 140 of Figure 1, as previously discussed). According to 
the homogenous block file and mid- variance file, which list the locations of homogenous 
blocks and mid-variance blocks, respectively, blocks from the cover image are selected and 
the Walsh transformation is applied to these blocks. In the present example, the blocks are (8 
x8). 

[0066] With reference now to Figure 4, Figure 4 is a flow diagram illustrating a detailed 
process 400 to implement robust digital image watermarking utilizing a Walsh transform 
algorithm, according to one embodiment of the present invention. Particularly, as detailed in 
Figure 4, at block 410 the spatially dispersed watermark symbol Lj, which as previously 
discussed is dispersed in accordance with the previously generated pseudo-random private 
key, is received. Next, a plurality of homogenous blocks and mid- variance blocks are 
selected (block 420). Based on this data, bits of the spatially dispersed watermark symbol Li 
are inserted into homogenous and mid- variance blocks, respectively, of the cover image 
utilizing a Walsh transform. Particular details of this process are discussed below. 
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[0067] Continuing with the present example, for an (8 x 8) block from the homogenous block 
file, a pixel from spatially dispersed watermark symbol Li is inserted as the DC coefficient or 
mean value of the Walsh transformation, e.g. the W (0,0) value of such block. For example, 
let the integer part of W (0,0) be A (0,0). The bit plane representation of A (0,0) requires at 
most 8 binary digits for a gray-level image. Assume that the bit plane representation of A 
(0,0) is denoted by Sg, S7, S6, S5, S 4 , S3, S2, and Si. One pixel from Li replaces a particular 
bit (e.g. preferably Least Significant Bit planes S3 or S2 or Si) in the bit plane representation 
of A (0,0) for each homogenous block. 

[0068] Similarly, in each block of mid-variance range from the mid-variance block file, the 
highest Walsh coefficients, other than DC coefficient, are used to hide one pixel from the 
spatially dispersed watermark symbol Li. The insertion of watermark pixels is done in the 
same way as described above for homogenous blocks. 

[0069] For both the homogenous and mid- variance blocks, the selection of a particular bit in 
the bit plane representation may be determined based on the local characteristics (e.g. the 
busyness and/or smoothness of regions) of the block (i.e. sub-image) in the cover image. For 
example, a heuristic approach for such bit position selection for both regions may be used. 
This heuristic approach may alternatively be governed by the global characteristics of the 
cover image besides the local properties of a candidate block or in addition thereto. 
[0070] Furthermore, in connection with selection of proper bit position for watermark 
insertion, the chosen bit position should not be fixed for the entire range of variance in either 
zone (i.e. the homogenous or mid-variance zones). Bit position selection instead should 
depend on a variance value of a candidate block. For example, in one embodiment, in either 
zone (homogenous or mid-variance) the range of variance values may be divided into 
different disjoint sub-bands and a particular bit position may be assigned for each such sub- 
band. 

[0071] Continuing with the present example, variance values for homogenous blocks may 
range from 0 to 15 and this range is divided into three disjoint sub-bands, for example: 0-5, 5- 
10, and 10-15, etc. For blocks with variance value in the range 0-5, S\ may be used to hide a 
watermark pixel, S2 for blocks with variance value in the range 5-10 may be used to hide a 
watermark pixel, S 3 for blocks with variance value in the range 10-15 may be used to hide a 
watermark pixel, etc. 
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[0072] The higher the value of variance of a particular sub-band within the variance range, 
the higher the bit position in bit plane representation that is needed and is used for watermark 
insertion of the spatially dispersed watermark symbol Lj. Thus, for watermark insertion in 
variable bit positions of Walsh coefficients, two other data files are formed, namely a bit 
positions for homogenous blocks file and a bit positions for mid- variance blocks file, which 
record the position of a selected bit for each block for both the homogenous and mid- variance 
blocks, respectively. These may be in the form of look-up tables, for example. Particularly, 
the bit positions for mid-variance blocks file also keeps the actual position of the highest 
Walsh coefficient within the block. The positional information of the bit positions for 
homogenous blocks and bit positions for mid- variance blocks files are used to help to extract 
the watermark symbol from the proper bit position of Walsh coefficients, as will be 
discussed. 

[0073] It should be noted that the choice of a higher order LSB plane (e.g. 4 th or higher from 
the bottom plane, i.e., S 8 , S 7 , S 6 , S 5 , S 4 ), instead of the LSB plane, for watermark insertion of 
the spatially dispersed watermark symbol may result in more robust watermarking at the cost 
of visual distortion of the cover image. 

[0074] In order to minimize this aberration and for possible survival of the embedded 
information from the effect of the possible attack like low pass filtering further bit 
manipulation is made for Walsh coefficients used in the watermark insertion of the spatially 
dispersed watermark symbol. Implementation of this scheme may be done in anticipation of 
possible change of data attacks like mean filtering. In order to accomplish this, fractional 
parts of Walsh coefficients are used in watermark insertion and are appended with their 
corresponding integer parts. 

[0075] An inverse Walsh transformation is then applied for all blocks used to hide a 
watermark pixel of the spatially dispersed watermark symbol and are placed in their 
respective position in the cover image. The watermarked data thus obtained for the cover 
image is further low pass filtered, for example using a mask of size (7 x 7) pixels. This larger 
sized spatial mask used in such an operation makes the data insertion perceptually invisible, 
because the eye acts as a spatial low-pass filter. 

[0076] Continuing with the present example, assume an A (0, 0) value for a homogenous 
block before and after low pass filtering of an intermediate watermarked image Ai (0, 0) and 
A2 (0, 0), respectively, and assuming that watermark pixel is inserted in third Least 
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Significant Bit (LSB) position, i.e. S3, in the bit plane representation of A (0, 0) for a 
particular block. 

[0077] Further, continuing with present example, where 3 LSBs of Ai (0, 0), i.e., S3, S2 Si are 
1,1, and 0, respectively, three possible manipulations may be implemented as follows: 

(a) If A 2 (0, 0) > Ai (0, 0) then two LSBs of Ai (0, 0), i.e., S 2 and Si are forced to 
"0"converting the three LSBs of A, (0, 0) as 100, i.e. S 3 S 2 Si now become 100. 

(b) If A 2 (0, 0) < Ai (0, 0) then two LSBs of Ai (0, 0), i.e., S 2 and Si are forced to 
'T'converting the three LSBs of A\ (0, 0) as 1 1 1, i.e., S3 S 2 Si now become 111. 

(c) If A 2 (0, 0) = Ai (0, 0) no data manipulation is done, i.e., gray values of all pixels of the 
current blocks thus obtained remain unchanged, i.e., Ai (0, 0) as 1 10. 

[0078] The manipulation for other combinations of lower bit planes may also be 
accomplished in the same way. The manipulation of Walsh coefficients used for insertion of 
a watermark pixel of a spatially dispersed watermark symbol in mid-variance blocks is also 
done in same way as described for homogenous blocks. Next, a block-based inverse Walsh 
transformation is then applied in all such blocks and is placed in proper position of the cover 
image. This completes the watermark insertion of the watermark symbol. 
[0079] It should be noted that blocks not used in watermark insertion remain unchanged 
throughout the data hiding process. Only the blocks of the type that are in vicinity of 
homogenous or mid variance-blocks may have a major contribution in manipulation of Walsh 
coefficients used in watermark insertion of the watermark symbol; but the data values of such 
blocks in the actual watermarked image and in the cover image itself remain completely 
unchanged. By inserting the same watermark symbol in different regions of a cover image 
redundancy in the hidden information is ensured. 

[0080] Turning now to Figure 5, Figure 5 shows a block diagram 500 illustrating the 
extraction of a watermark symbol from a watermarked cover image, according to one 
embodiment of the invention. Particularly, Figure 5 illustrates the last step of the previously- 
described process in which the watermark symbol 502 is extracted from the cover image 504 
(block 150 of Figure 1, as previously discussed). 

[0081] As shown in Figure 5, two image processing platforms 501 and 503 may be 
communicatively coupled to one another via a link 505. The link 505 may be broadly 
defined as one or more physical or virtual information carrying mediums that establish a 
communication pathway such as, for example, optical fiber, electrical wire, cable, bus traces, 
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wireless channels (e.g. radio, satellite frequency, etc.) and the like. For example, the link 
may include a computer network (e.g. a wide area network (WAN), the Internet, a Local Area 
Network (LAN)) used to transfer digital data traffic utilizing Internet Protocol (IP), 
Asynchronous Transfer Mode (ATM), Frame Relay (FR), Point-to Point Protocol (PPP),or 
any other sort of protocol. Data traffic through the network may be of any type including 
voice, graphics, video, audio, e-mail, fax, text, multi-media, documents and other generic 
forms of data. 

[0082] The image processing platforms 501 and 503 may be any sort of computing or 
networking device (e.g. personal computer, network computer, server, copier, fax, lap-top 
computer, mobile computing device, cell-phone, etc.). Such computing or networking 
devices may include a processor 508, a memory 5 10, input/output devices, etc. The two 
image processing platforms 501 and 503 may also just be integrated circuits. It should be 
appreciated that the image processing platforms 501 and 503 may be any sort of device or 
machines capable of implementing instructions. 

[0083] In this example, the image processing platform 501 implements the previously- 
described processes relating generally to receiving a cover image 504 and a watermark 
symbol 502, generating a key, embedding the watermark symbol into the cover image 
utilizing a Walsh transform and the previously-described techniques, and further transmitting 
the Walsh transformation of the cover image with the embedded water mark symbol 512 via 
link 505 to the second image processing platform 503. 

[0084] The second image processing platform 503 receives the Walsh transformation of the 
cover image with the embedded water mark symbol 512 from the first image processing 
platform 501. 

[0085] The second image processing platform 503 also receives the key 522 and either the 
cover image 504 and/or the homogenous and mid-variance block files 524, previously 
discussed. The homogenous and mid-variance block files 524 include the homogenous block 
data file and the mid- variance data file listing the location of homogenous blocks and mid- 
variance blocks, respectively, and the bit positions for homogenous blocks data file and the 
bit positions for mid- variance blocks data file, which record the position of a selected bit for 
each block for both the homogenous and mid- variance blocks, respectively, all four of which 
have been previously discussed in detail. The second image processing platform 503 may 
receive these items from the first image processing platform 501 or from other sources. 
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[0086] Based on this received data, the second image processing platform 503 can extract the 
watermark symbol 502 from the watermarked cover image to verify its authenticity. 
[0087] The extraction of the watermark symbol 502 by the second image processing platform 
requires both the original cover image 504 and the key 522 used to permute the spatial 
relationship of the watermark symbol before its insertion into the cover image 504, as 
previously discussed. 

[0088] Since the private key 522 is required, embodiments of the invention for robust digital 
image watermarking techniques utilizing a Walsh transform algorithm relate to the class 
private watermarking techniques. 

[0089] Further, in some embodiments, along with private key 522 either the original cover 
image 504, or, the homogenous and mid-variance block files 524 (including the previously- 
discussed data files related to the homogenous block file, mid-variance block file, the bit 
positions for the homogenous blocks file, and the bit positions for the mid-variance blocks 
file) are required in order to locate the position of the watermark symbol 502 in a possibly 
distorted watermarked image 512 and to extract the watermark symbol 502 from the possibly 
distorted watermarked image 512 during watermark extraction at distant place, such as image 
processing platform 503. The watermark symbol 502 may be extracted from the 
watermarked image 512 (i.e. the Walsh transformation of the cover image with the embedded 
watermark symbol) by the reverse or inverse of the previously-described process used to 
embed the watermark symbol using the Walsh transformation in the cover image. 
[0090] Continuing with the previous example, the watermarked image 512 under inspection, 
has been divided or partitioned into non-overlapping block of size 8x8 pixels, as previously 
discussed. 

[0091] During the extraction process, a homogenous block of the watermarked image 512 
(currently under inspection) that belongs to the look-up table (i.e. data file) related to 
homogenous blocks is examined for watermark extraction. Block-based Walsh 
transformation is applied for all such homogenous blocks by interrogating the look-up table 
(i.e. data file) for bit positions for the homogenous blocks file and in this way one watermark 
pixel is extracted from bit plane representation of A (0, 0) value for each homogenous block. 
In this way, the same spatially dispersed watermark symbol is extracted from the possibly 
distorted watermarked image 512 (including a watermarked image after some external 
attack). 
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[0092] Similarly, the watermark symbol 502 can also be extracted from the mid-variance 
blocks of the watermarked image 512 under inspection. During the extraction process, a mid- 
variance range block of the watermarked image 512 (currently under inspection) that belongs 
to the look-up table (i.e. data file) related to mid-variance blocks is examined for watermark 
extraction. Block-based Walsh transformation is applied for all such mid-variance blocks by 
interrogating the look-up table (i.e. data file) for the bit positions for the mid-variance blocks 
file and in this way one watermark pixel is extracted from the bit plane representation of the 
integer part of highest Walsh coefficients W (x, y) value. In this way the same spatially 
dispersed watermark symbol is extracted from the possibly distorted watermarked image 512 
(including a watermarked image after some external attack). 

[0093] Further, in this way, the same spatially dispersed watermark symbol is extracted from 
two different zones (i.e. homogenous zones and mid-variance zones) of the possibly distorted 
watermarked image 512. 

[0094] The spatially dispersed watermark symbol thus obtained from either zone (i.e. 
homogenous zones or mid-variance zones) is once again permuted using the same key 522 
(pseudo-random number) used earlier to permute the spatial relationship of the watermark 
and watermark symbol 502 in its original form is thus obtained. This completes watermark 
extraction process. 

[0095] It appears that a watermark symbol inserted into two different zones (i.e. homogenous 
zones or mid-variance zones) of the cover image 504 shows different degree of robustness to 
different type of attacks, as will be discussed below. Between two watermark symbols 502, 
extracted from the two different zones, the better one on the basis of visual quality may be 
considered as the best authentication mark in a particular situation. 
[0096] Thus, embodiments of the present invention provide for computationally efficient 
private digital image watermarking utilizing Walsh coefficients. An advantage of the Walsh 
transformation over other unitary transforms, such as the Fourier transform, which have a 
kernel of complex exponential terms, is that the Walsh transform kernel consists of only a 
signed integer value +1 and -1, which does not require floating point multiplication during 
implementation. Thus, the Walsh transform is computationally efficient. 
[0097] Another advantage is that while the spatial mid-frequency zone of the cover image is 
used to hide watermark symbol information in order to optimize the trade off between 
watermark transparency and robustness against lossy data compression like Joint 
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Photographic Experts Group (JPEG); watermark symbol insertion also occurs in the spatial 
low frequency zone or homogenous zone of the image, which shows high resiliency against 
common signal processing operations like mean and median filtering. Accordingly, 
redundancy in distribution of the hidden watermark symbol information occurs in two 
different non-overlapping zones of the cover image to accommodate the effect of various 
types of external attacks. Redundancy in hidden watermark symbol information also ensures 
watermark extraction even from a truncated or incomplete watermarked image. 
[0098] Along with resiliency to common signal processing operations like mean filtering, 
median filtering, lossy data compression like JPEG with compression ratios, and low Peak 
Signal to Noise Ratio (PSNR) values, the previously described process provides robustness to 
symmetric image cropping, random and deliberate lower order bit plane(s) manipulation of 
gray values, and changes in the dynamic ranges of gray levels tested over large number of 
bench marking images as suggested by watermarking community. 

[0099] It will, of course, be understood that, although particular embodiments have just been 
described, the claimed subject matter is not limited in scope to a particular embodiment or 
implementation. For example, one embodiment may be in hardware, whereas another 
embodiment may be in software. Likewise, an embodiment may be in firmware, or any 
combination of hardware, software, or firmware, for example. Likewise, although the 
claimed subject matter is not limited in scope in this respect, one embodiment may comprise 
an article, such as a storage medium. Such a storage medium, such as, for example, a CD- 
ROM, or a disk, may have stored thereon instructions, which when executed by a system, 
such as a computer system or platform, or an imaging system, for example, may result in an 
embodiment of a method in accordance with the claimed subject matter being executed, such 
as an embodiment of a method for robust digital image watermarking techniques utilizing a 
Walsh transform algorithm, for example, as previously described. For example, an image 
processing platform system may include an integrated circuit, a processing unit, an 
input/output device and/or memory, etc. 

[00100] Further, while embodiments of the present invention and its various functional 
components have been described in particular embodiments, it should be appreciated that the 
embodiments of the present invention can be implemented in hardware, software, firmware, 
middleware or a combination thereof and utilized in systems, subsystems, components, or 
sub-components thereof. 
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[00101] When implemented in software or firmware, the elements of the present 
invention are the instructions/code segments to perform the necessary tasks. The program or 
code segments can be stored in a machine readable medium (e.g. a processor readable 
medium or a computer program product), or transmitted by a computer data signal embodied 
in a carrier wave, or a signal modulated by a carrier, over a transmission medium or 
communication link. The machine-readable medium may include any medium that can store 
or transfer information in a form readable and executable by a machine (e.g. a processor, a 
computer, etc.). Examples of the machine-readable medium include an electronic circuit, a 
semiconductor memory device, a ROM, a flash memory, an erasable programmable ROM 
(EPROM), a floppy diskette, a compact disk CD-ROM, an optical disk, a hard disk, a fiber 
optic medium, a radio frequency (RF) link, etc. The computer data signal may include any 
signal that can propagate over a transmission medium such as electronic network channels, 
optical fibers, air, electromagnetic, RF links, bar codes, etc. The code segments may be 
downloaded via networks such as the Internet, Intranet, etc. 

[00102] Additionally, while embodiments of the invention have been described with 
reference to illustrative embodiments, these descriptions are not intended to be construed in a 
limiting sense. Various modifications of the illustrative embodiments, as well as other 
embodiments of the invention, which are apparent to persons skilled in the art to which 
embodiments of the invention pertain, are deemed to lie within the spirit and scope of the 
invention. 



RESULTS 



Correlation Measurement 

[00103] Because embodiments of the invention related to robust digital image 
watermarking techniques utilizing a Walsh transform algorithm are utilized to hide a 
recognizable pattern such as a watermark symbol, the visual degradation of the extracted 
watermark symbol may be compared with reference to the original watermark symbol. The 
subjective measurement of the degradation of the extracted watermark symbol depends on 
viewer expertise, the nature of the operations performed, sometimes the structure of 
watermark symbol itself, and the local and global characteristics of the cover image to be 
watermarked, and the experimental conditions. A quantitative measurement of the extracted 
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watermark symbol image fidelity may be measured between the original or reference 
watermark symbol L and the extracted watermark symbol L' by a normalized cross 
correlation (NCC) where: 

NCC=Zx Zy L (x, y) V (x, y) / Zx Zy [ L (x, y)]2; 
which is the cross correlation normalized by the watermark energy to give a maximum value 
of NCC as unity. 

Examples 

[00104] Figures 6A and 6B are images showing a fishing boat and a women (named 
Lena, hereinafter referred to as the "Lena image"), respectively, used as test cover images, 
and Figures 7A and 7B are the watermarked images of Figures 6A and 6B, respectively, 
using a watermark symbol "M" as shown in Figure 7C, using the previously described 
embodiments of the invention for robust digital image watermarking techniques utilizing a 
Walsh transform. Test results show that the Peak Signal to Noise Ratio (PSNR) of the 
watermark images Figures 7A and 7B to the cover images Figures 6A and 6B are about 36.00 
dB and 37.80 dB, respectively. Therefore, quality degradations of the watermarked image 
could hardly be perceived by the human eye. 

[00105] Further, robustness to different possible signal processing operations will later 
be discussed with reference to respective tables for five test images: a bear, New York, an 
opera, a F151 fighter aircraft, and pill images. These test images are shown as Figures 6C, 
6D, 6E, 6F, and 6G, respectively. 

Mean Filtering Operation 

[00106] Images are sometime smoothed using a mask of suitable size to remove 
spurious effect that may occur as a result of sampling, quantization or because of poor 
transmission channel, etc. Figures 8A and 8B show blurred versions of a watermarked 
fishing boat image after first and second time mean filtering, respectively, using a 3 x 3 
window. The PSNR values corresponding to Figures 8A and 8B are 25.32 dB and 23.62 dB, 
respectively, wherein Figures 8C and 8D show an extracted watermark symbol with 
NCC=0.98 and NCC=0.83 respectively, which were extracted using the previously described 
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embodiments of the invention for robust digital image watermarking techniques utilizing a 
Walsh transform from Figures 8A and 8B, respectively. The extracted watermark symbol is 
found to be still recognizable. 

[00107] Similarly, Figures 9A and 9B show blurred versions of a watermarked Lena 
image after first and second time mean filtering, respectively. The PSNR values 
corresponding to Figures 9A and 9B are 27.75 dB and 25.60 dB, respectively, wherein 
Figures 9C and 9D show an extracted watermark symbol with NCC=1.00 and NCC=0.88, 
respectively, which were extracted using the previously described embodiments of the 
invention for robust digital image watermarking techniques utilizing a Walsh transform from 
Figures 9A and 9B, respectively. The extracted watermark symbols, although disturbed by 
noise, is still recognizable 

[00108] Figure 10 shows a table of test results of the robustness to mean filtering for 
the other five test images when utilized with embodiments of the invention for robust digital 
image watermarking techniques utilizing a Walsh transform. 

Median Filtering Operation 

[00109] To reduce significantly the blurring effect, median filtering is applied to 
images, the principal functioning of which is to eliminate intensity spikes that appear isolated 
in the area of the filter mask. Figures 1 1 A, 1 IB, and 1 1C show watermarked fishing boat 
images after 1st, 2nd and 5th time median filtering. The PSNR values corresponding to 
Figures 1 1 A, 1 IB, and 1 1C are 25.99 dB, 25.56 dB and 24.55 dB, respectively. Extracted 
watermark symbols are shown in Figures 1 ID, 1 IE, and 1 IF with their NCC values of 0.946, 
0.949 and 0.93, respectively, which were extracted using the previously described 
embodiments of the invention for robust digital image watermarking techniques utilizing a 
Walsh transform from Figures 1 1 A, 1 IB, and 1 1C, respectively. The extracted watermark 
symbols in all cases are fully recognizable although they are interfered with noise by different 
amounts. 

[00110] Similarly, Figures 12A, 12B, and 12C show watermarked Lena images after 
1st, 2nd and 5th time median filtering. The PSNR values corresponding to Figures 12A, 12B, 
and 12C are 29.49 dB, 28.89 dB and 27.76 dB, respectively. Extracted watermark symbols 
are shown in Figures 12D, 12E, and 12F with their NCC values of 0.994, 0.988 and 0.797, 
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respectively, which were extracted using the previously described embodiments of the 
invention for robust digital image watermarking techniques utilizing a Walsh transform from 
Figures 12 A, 12B, and 12C, respectively. The extracted watermark symbols in all cases are 
fully recognizable although they are interfered with noise by different amounts. 
[00111] Figure 13 shows a table of test results of the robustness to median filtering for 
the other five test images when utilized with embodiments of the invention for robust digital 
image watermarking techniques utilizing a Walsh transform. 

Image Cropping Operation 

[00112] The robustness of the previously-described embodiments of the invention for 
robust digital image watermarking techniques utilizing a Walsh transform against different 
types of image cropping operations that may be performed, for example, as a deliberate 
external attack, on the watermarked image has also been tested. Because the watermark 
pixels of the watermark symbol are inserted with sufficient redundancy in the cover image, it 
is difficult for an outsider to detect or remove the watermark symbol by cutting some part of 
the cover image. So it is still possible to extract the watermark symbol with recognizable 
quality even from a truncated watermarked image. 

[00113] Image cropping operations have been simulated by altering data with arbitrary 
values (e.g. 150) in a quarter of a watermarked image in upper left, upper right, lower left and 
lower right one at a time, and in all cases, the extracted watermark symbol, although 
interfered by noise by different amount, was still recognizable. 

[00114] Figures 14A, 14B, 14C, and 14D show a watermarked fishing boat image with 
the image cropping operation as mentioned earlier and their PSNR values of 26.1 1 dB, 21.13 
dB, 20.05 dB andl6.85 dB, respectively. Extracted watermark symbols with their NCC 
values 0.84, 0.86, 1.0 and 1.0, respectively, are shown in Figures 14F, 14G, 14H, and 141 
respectively, which were extracted using the previously described embodiments of the 
invention for robust digital image watermarking techniques utilizing a Walsh transform from 
Figures 14 A, 14B, 14C, and 14D, respectively. In all cases the extracted watermark symbol, 
although interfered by noise by different amounts, were still recognizable. 
The same operations were performed for watermarked Lena image and are shown in 1 5 A, 
15B, 15C, and 15D, respectively, with their PSNR values of 21.13 dB, 19.16 dB, 16.80 dB, 
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and 19.84 dB respectively. Extracted watermark symbols with their NCC values 0.98, 0.82, 
0.97 and 1.00 respectively, are shown in Figures 15F, 15G, 15H, and 151, respectively, which 
were extracted using the previously described embodiments of the invention for robust digital 
image watermarking techniques utilizing a Walsh transform from Figures 15 A, 15B, 15C, 
and 1 5D respectively. In all cases the extracted watermark symbol, although interfered by 
noise by different amounts, were still recognizable. 

[00115] Image cropping operations have also been simulated by altering the pixel 
values of 20 rows and columns from the border of an image with some arbitrary value (e.g., 
150). Figure 14E shows a watermarked fishing boat image (PSNR=21.08 dB) with such an 
operation and an extracted watermark symbol with NCC= 0.60 shown in Figure 14J. Figure 
15E shows a similar type of image cropping operation for a watermarked Lena image with 
PSNR value 18.75 dB and an extracted watermark symbol with NCC = 0.79 shown in Figure 
15J. 

[00116] Figure 16 shows a table of test results of the robustness to different types of 
image cropping operations for other five test images when utilized with embodiments of the 
invention for robust digital image watermarking techniques utilizing a Walsh transform. 

JPEG Compression 

[001 17] Experimental test results show that when utilized with embodiments of the 
invention for robust digital image watermarking techniques utilizing a Walsh transform that 
as the compression ratio increases, the NCC value of the extracted watermark decreases and 
the quality of the extracted watermark will also decrease accordingly. Further, experimental 
test results show that watermark information hidden in the mid-variance blocks of the cover 
image remains almost unaffected even after JPEG compression with high compression ratio 
and low PSNR values. Thus, embodiments of the invention provide for a high-level 
robustness even with JPEG compression. 

[00118] Figure 1 7 A shows a table of test results of the robustness to JPEG 
compression for the other five test images when utilized with embodiments of the invention 
for robust digital image watermarking techniques utilizing a Walsh transform. Figures 17B 
and 17C are the extracted watermark symbol after decompression from the JPEG compressed 
images of Figure 7A with compression ratios of 31.80 and 44.56, respectively. 
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Deliberate Least Significant Bits Manipulation 

[00119] Least significant bits for all the pixels, or randomly selected pixels, of the 
watermarked image were complemented and the extracted watermark symbol was still found 
to be of good quality up to a certain degree of bit alteration, using embodiments of the 
invention for robust digital image watermarking techniques utilizing a Walsh transform. 
Figures 18A and 18B show a watermarked Lena image that has undergone this operation with 
PSNR values of 47.71 dB and 34.47 dB, respectively. Extracted watermark symbols are 
shown in Figures 18C and 18D, with NCC values 0.95 and 0.79, respectively, which were 
extracted using the previously described embodiments of the invention for robust digital 
image watermarking techniques utilizing a Walsh transform from Figures 18A and 18B, 
respectively. 

[00120] Figure 19 shows a table of test results of the robustness to deliberate least 
significant bits manipulation for the other five test images when utilized with embodiments of 
the invention for robust digital image watermarking techniques utilizing a Walsh transform. 

Change of Gray Level Dynamic Range 

[00121] In some cases, there may be an intentional approach to remove a watermark 
symbol by changing the gray level dynamic range of the watermarked image. One such 
approach for the watermarked fishing boat image was tested for and is shown in Figure 20, 
which was done by changing the dynamic range from 1-255 to 50-200. The PSNR value of 
the watermarked image after such operation to the original watermarked image is 21 .99 dB 
and the extracted watermark symbol is shown in Figure 21 with NCC=0.92, which was 
extracted using the previously described embodiments of the invention for robust digital 
image watermarking techniques utilizing a Walsh transform from Figure 20. 
[00122] Another case was also tested, where the dynamic range of gray level for the 
watermarked Lena image was changed from 22-243 to 200-50. The PSNR value of the 
watermarked image after such operation to the original watermarked image is 23.42 dB and is 
shown in Figure 22A. The extracted watermark symbol is shown in Figure 22B, which was 
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extracted using the previously described embodiments of the invention for robust digital 
image watermarking techniques utilizing a Walsh transform from Figure 22A. 
[00123] Figure 23 shows a table of test results of the robustness to different possible 

changes in gray level dynamic range for the other five test images when utilized with 
embodiments of the invention for robust digital image watermarking techniques utilizing a 
Walsh transform. 



-24- 



